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ABSTRACT 


The  purpose  of  this  paper  is  to  give  an  alternative  proof  to  the 
decidability  of  the  emptiness  problem  for  tree  automata,  as  shown  in 
Rabin  [4].  The  proof  reduces  the  emptiness  problem  for  automata  on 
infinite  trees  to  that  for  automata  on  finite  trees,  by  showing  that 
any  automata  definable  set  of  infinite  trees  must  contain  a  finitely- 
generable  tree. 
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Section  1:  Introduction 

The  analysis  of  finite  automata  on  infinite  trees  is  the  basis  for 
Rabin's  remarkable  proof  of  the  decidability  of  S2S  (the  monadic  second- 
order  theory  of  two  successors)  [5].  Rabin's  proof  follows  the  now 
standard  form  of  Buchi  and  Elgot's  proof  for  WSlS  (weak,  single  successor) 
[1,  3]  and  Thatcher -Wright' s  proof  for  weak  S2S,  and  requires  demonstrating 
effectively  that  the  automata  are  closed  under  union,  projection,  and 
negation,  and  that  the  emptiness  problem  for  the  automata  is  decidable. 

As  in  the  case  of  SIS,  the  main  technical  difficulty  in  the  case  of  S2S 
lies  in  proving  closure  under  complementation  of  sets  accepted  by  non- 
deterministic  automata  on  infinite  trees.  The  problem  is  complicated  by 
the  fact  that  nondeterministic  infinite  tree  automata  are  known  not  to 
be  equivalent  to  any  of  the  likely  definitions  of  deterministic  infinite 
tree  automata. 

Curiously,  the  emptiness  problem,  which  is  easy  for  the  other  kinds 
of  automata,  turns  out  to  be  nontrivial  for  (nondeterministic)  infinite 
tree  automata.  Rabin  subsequently  improved  his  original  proof  of  the 
decidability  of  this  emptiness  problem,  but  even  the  second  proof  [4] 
used  an  involved  induction  and  consequently  does  not  yield  a  simple 
effective  criterion  for  deciding  emptiness. 

In  this  paper  we  provide  such  a  criterion  by  showing  that  an 
infinite  tree  automaton  accepts  some  valued  tree  if  and  only  if  there 
is  a  computation  of  the  automaton  containing  a  certain  simple  kind  of 
finite  subtree.  Moreover,  the  set  of  finite  subtrees  of  the  kind  we 
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require  are  recognizable  by  finite  tree  automata,  and  in  this  way  we 
reduce  the  emptiness  problem  for  infinite  tree  automata  directly  to  that 
for  finite  tree  automata.  This  also  yields  a  simpler  proof  of  another  result 
of  Rabin  about  "regular"  runs  by  automata  (see  below). 

The  hardest  part  of  Rabin's  proof  --  the  complementation  lemma  -- 
remains  a  difficult  combinatorial  argument  which  has  yet  to  be  simplified. 

Reducing  this  problem  to  the  corresponding  problem  of  complementing 
finite-tree  automata  (which  is  easily  resolved  by  the  usual  subset 
construction)  might  lead  to  such  a  simplification.  Our  results  on 
emptiness  suggest  that  there  is  hope  for  this  approach. 


Section  2: 

For  this  paper  the  appropriate  way  to  visualize  the  infinite  binary 
tree  T  is  as  follows.  At  the  top  is  the  root  ZV  Every  x  €  T  has  a 

•jJf 

left  son  xO  and  a  right  son  xl.  Hence,  T  =  (0,1}  . 


00  01  10  11 

/  \  /  \  /  \  /  \ 


We  define  a  partial  ordering  on  T  by  x  £  y  (x  is  an  initial  of  y) 

* 

if  y  =  xz  for  some  z  €  (0,1}  .  If  x  s  y  and  x  4  y,  then  we  will  write 


x  <  y. 
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A  path  tt  of  T  is  a  set  it  c  T  satisfying  1)A?  tt;  2)  for  y  €  tt, 
either  yO  6  tt  >r  yl  fc'  n,  but  not  both;  3)  tt  is  a  minimal  subset  of  T 
satisfying  1  and  2. 

Definition:  If  for  some  path  tt,  x  6  tt  and  y  €  tt,  then  we  denote  by 
[x,yj  the  set  (w|x  £  w  £  y}  .  Note  that  when  y  <  x,  [x,y]  =  0. 

For  a  set  B  we  denote  the  cardinality  of  B  by  c(B). 

Definition:  A  set  B  c  T  is  called  a  frontier  of  T  if  for  every  path 
tt  c:  t  we  have  c(tt  D  B)  =  1.  By  Konig's  Lemma  every  frontier  is  finite. 

A  finite  tree  is  a  set  E  =  ( y | y  £  w,  for  some  w  €  B} ,  where  B  is  a  fixed 

frontier  of  T.  For  E  as  above,  B  is  called  the  frontier  of  E  and  is 

denoted  bv  Ft(E). 

Definition:  A  2" tree  is  a  pair  (v,T)  such  that  v:  T  -+  £.  A  finite 
5- tree  is  a  pair  (v,E)  such  that  v:  E  -+  £,  where  E  is  a  finite  tree. 

Definition:  For  a  mapping  0:  A  •+  B.  In  (0)  =  {b|c(0_1(b))  .  ;>W], 

Definition:  Let  0  :  A  -+  B  and  let  _0.  =  ((L^,  U^))-^  ^  ^  ^  be  a  sequence 

of  pairs  of  finite  sets.  We  say  that  6  is  of  type  -Q-.  denoted  by 
0  €  [a],  if  for  some  i,  1  <:  i  <;  n,  we  have  ln(0)  fl  =  0  and  ln(0)  D  ^  0. 

Definition:  Art  f»a<  t »  is  a  system  <  S,  L,  M,  Sq,^2.>,  where  S  is  a 

finite  set  of  states ,  T<  is  a  finite  set,  M:  S  x  S  -+  P(S  X  S),  sQ  €  S  is 

the  initial  state,  and  .Q  =  ((L. ,  u  .)), 

i  i  1  £  i  £  n 
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If  t  (vja)  if-  a  S-tree,  then  an  ^T-run  on  _t  is  any  mapping  r:  T  -+  S 
such  that: 

1)  r(A)  =  sQ,  and 

2)  for  all  y  6  T, 

(r(yO) ,  r(yl))  €M(r(y),  v(y)). 

If  e  =  (v,E)  is  a  finite  E-tree,  then  an  ffi-run  on  e  is  any  mapping 
r:  E  -*  S  such  that: 

1)  r(A)  =  Sq ,  and 

2)  for  all  y  €  E  -  Ft(E), 

(r(yO),  r (yl) )  €M(r(y),  v(y)). 

The  set  of  all  01- runs  on  t(e)  will  be  denoted  by  Rn(0f,  t)  (Rn(0T,e),  respectively). 
An  accepting  Oj-ruri  on  t  is  any  r  €  Rn(#,t)  such  that  for  every  path 
it  c  T,  (r | tt)  €  1*1].  1(00  =  f  1 1  there  is  an  accepting  ^-run  on  t]  .  T(W) 

is  called  the  set  defined  by  Ol. 

Given  an  f.a.t.  0L=  <  S,  E,  M,  Sp,il.>  we  wish  to  determine  whether 

or  not  T(d)  =  0.  Consider  the  automaton  0l=  <  S,  {a},  M,  sQ,-fl>,  where 

for  all  s  €  S,  M(s,a)  =  (J  M(s,a).  Clearly,  T (0$  =  0  iff  T(^)  =  0. 

a€E 

Thus  the  emptiness  problem  is  reduced  to  the  case  of  automata  over 
the  single  letter  alphabet  [a] .  Henceforth  we  restrict  our  attention  to 
this  case.  Since  there  exists  just  one  fa} -tree,  (v,T),  and  for  every  finite 
tree  E  just  one  finite  fa] -tree,  (v,E  ),  we  will  omit  mention  of  the 
valuation  v  and  talk  about  0(-runs  on  T  and  E,  ^accepting  T,  etc. 
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Theorem  1:  Let 01=  <  S.  fat.  M.  s„,  ((L.,  U.))„  ...  >  be  an  f.a.t. 

u  i  lisisn 

T(0$  ^  0  «  for  some  finite  tree  E  there  exists  an  r  such  that 

1)  r  €  Rn(0T,E) , 

2)  there  exist  mappings  J:  Ft(E)  ■+  E-Ft(E)  and  H:  Ft(E)  -* 
E-Ft(E)  such  that  for  all  x  £  Ft(E) 

a)  H(x)  £  J(x)  <  x, 

b)  r  (J  (x) )  =  r  (x) , 

c)  r([H(x),  J(x)])  =  r([J(x),  x]), 

d)  for  some  i,  1  £  i  £  n,  r([J(x),  x])  fl  1.  =  ^  end  r(x)  6 

Before  we  prove  Theorem  1,  we  show  that  Theorem  1  easily  yields  the 
following  theorem. 

Theorem  2:  The  emptiness  problem  for  f.a.t. 's  is  decidable. 

Proof  of  Theorem  2:  Let  01  be  as  in  the  statement  of  Theorem  1. 

Definition:  Let  E  be  a  tree  (finite  or  infinite).  Let  r  be  an  01  -run 

* 

on  E.  Let  x  €  E.  Since  x  €  fO.l]  we  can  write  x  =  ct.ct_  ...  a  .  Define 

J  12m 

* 

Of  to  be  the  following  member  of  S  :  a  =  r(A$»r(<J1),r(o,1(J_). .  .r(x) . 
r  j  x  r  j  x  i  i  z 

Notation:  Let  a  be  a  string.  Let  n  and  m  be  positive  integers,  n  £  m. 

Then  by  cn( n)  we  will  mean  the  nth  element  (from  the  left)  of  a.  By 

(^([njm])  we  will  mean  the  set  of  elements  between  and  including  the  nth 

and  the  mth  places  of  ot. 
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Definition:  Let  a  €  S  .  We  say  that  a  is  Good  if  there  exist  positive 

integers  H  and  J  such  that  H  £  J  <  N  =  length(o-),  ot(J )  -  c^N) ,  o-([H,J]) 

cv(  [J , N] )  „  and  there  exists  an  i  such  that  a»(N)  6  U.  and  a([J,Nl)  D  L  = 

1  i 

Note  that  good  is  defined  with  respect  to  our  f.a.t. 

Lerana_l:  The  set  of  good  strings  is  a  regular  set,  i.e.,  it  is 
recognizable  by  a  finite  state  machine  on  finite  input  strings. 

Proof  of  Lemma  1:  Obvious.  Cl 

Lemma_2:  Let  G  be  a  regular  set  of  finite  strings  on  S.  Let  H  = 

{E|E  is  a  finite  free  and  there  exists  a  run  r  on  E  such  that  for  all 
x  €  Ft(E),  €  G}  Then  H  is  recognizable  by  a  finite  automaton  on 

finite  trees  as  defined  in  [6 ] . 

Proof  of  Lemma  2:  Fairly  obvious.  I  I 

Completion  of  proof  of  Theorem  2:  By  Theorem  1,  Lemma  1,  and  Lemma  2, 
the  emptiness  problem  for  0\  can  be  reduced  to  the  emptiness  problem 
for  a  particular  finite  automaton  on  finite  tree*;.  But  by  Theorem  7  in 
[6],  this  problem  is  decidable. 

Proof  of  ^  in  Theorem  1:  Let  r  be  an  accepting  01-run  on  T.  By  the 

definition  of  accepting  run  and  of  good  string,  it  is  clear  that  for 

every  path  tt  of  T  there  exists  an  x,  x  €  tt,  such  that  a  is  ti  good 

r ,  x 

string.  Let  B  =  {x^  ^  is  good  and  for  all  y  <  x,  a  isn't  good}. 

Then  B  is  a  frontier.  If  we  let  E  be  the  finite  tree  with  frontier  B, 
then  there  exist  mappings  J  and  H  which,  together  with  r[E,  satisfy 
conditions  1  and  2  of  Theorem  1.  This  completes  the  proof  of  =*. 
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Proof  of<*  in  Theorem  1:  Let  E,  r,  J  and  H  be  as  specified  in  1)  and 
2)  of  Theorem  1. 

We  define  a  mapping  T):  T  -♦  E  inductively  as  follows.  Let  T|(A)  =  A. 

If  tKx)  has  been  defined,  then  for  cr  6  f 0, 1} ,  define  r)(xo)  as  follows. 

-ase — -•  ^  "n(x)  C  E  -  Ft(E),  then  let  T)(xct)  =  T|(x),ct. 

Case_2:  If  r|(x)  €  Ft (E) ,  then  let  T)(x<7)  =  J(ti(x))*ct. 

Define  r:  T  -4  S  by  r(x)  =  r(ri(x)),  for  all  x  <=  T.  Clearly  by  2) 

b)  of  Theorem  1,  r  €  Rn(0|,  T)  so  that  it  suffices  to  show  that  for  all 

paths  ttCT,  (v  j  tt)  £  [0] ,  because  then  T  6  TCpf )  and  hence  T(q)  4  0. 

Let  tt  c  t  be  a  specific  path.  Let  yQ,  y^  y 2>  ...  be  the  infinite 
subset  of  tt  (listed  in  increasing  order  under  £)  consisting  of  exactly 
those  members  of  tt  whose  images  under  n  are  in  Ft(E) .  Define  V  to  be 

TT 

the  following  infinite  sequence  of  members  of  Ft(E)  x  Ft(E) : 

VTT  =  ^V’  WiH*  (TKy^*  r\(y2)),  (T)(y2),  r|(y3)),  ... 

For  all  i  <Wwe  huve  by  the  definition  of  T|,  J(T|(y^))  <  ,H(y.+j) 
and  r([y^,  -  r(  [J(T|(y^)) ,  T|(y^+^)  ]).  Hence,  In(r  |  tt)  = 

U  r([J(x),  z]). 

(x,z)  e  In(V  ) 

TT 

Clearly  there  exists  a  finite  sequence  (possibly  with  repetition) 
of  members  of  Ft(E),  Xj,  x2>  x3>  ...,  x  ,  such  that 
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(I) 


ln<V 


x,  =  x  and 
1  m 

{(Xj,  *2),  (x2,  x3),  (x3>  x4), 

(x_  ,,  x  )}  . 
m- 1  m 


From  now  on  we  will  denote  J(xi>  by  ^  and  HCx^)  by  for  all 
1  £  i  £  m. 

We  have  from  the  preceding  paragraph 


(II) 


for  all  1  £  i  <  m,  J  <  x  j, 


m-1 

and  In(r  In)  =  r(  [J^  x1+1jj. 


(r  |  tt)  6  [ft]  is  immediate  from  the  third  of  the  following  three 
lemmas . 

Lemma  3:  There  exists  an  M,  1  s  M  s  m,  such  that  for  all  i,  1  £  i  <;  m, 


^^i' 

That  is,  ■  min(H1>  H  } . 

Proof: 


Our  induction 


hypothesis  at  stage  h  is  that  there  exists  an  integer  M',  UH'  £  h, 
such  that  for  all  i,  1  <:  i  <:  h,  H^,  <:  H..  Clearly  the  basis  case  is 
trivial.  We  assume  the  induction  hypothesis  for  h  and  prove  it  for  h+1. 


,  by  the  induction  hypothesis. 


H.  ^  J  ,  by  2)  a)  in  Theorem  1. 

n  h 

Jh  <xh+i  ■  by  <«>• 

Hence,  1^,  < 

By  2)  a)  of  Theorem  1  we  also  have  Hh+1  <  x.+1-  Therefore 
Hh+i  are  comparable  (under  s) .  Clearly  for  all  i,  1  s  i  s  h+1, 

— ^HM”  Hh+1^  ^  Hi*  □ 

If  M  4  m,  we  can  rename  x^  x2,  . x  so  that  (I)  and  (II)  remain 
true  and  =  minf H^} .  Henceforth,  without  loss  of  generality 
we  assume  that  M  =  m. 


,  Hn  and 


Lemma  4:  If  Hm  =  min(H. ,  ....  H  },  then  for  all  i,  Isis  (m-1), 
m  — —  ^  m 


X1+1I)  2  r(!lV 


x. 


]). 


Proof:  Let  i  be  any  integer  such  that  1  s  I  <  m. 
hence  we  have  the  picture: 


H  <:  H 
m 


£  J. 


<  x 


i+1* 
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Hence,  r([Km>  x.+1])  2  r([Hm,  H.])  U  r([Hi>  JJ).  By  2)  c)  of  Theorem  1, 
r([Hi,  Jj)  =  r([Ji,  Xi]).  Hence,  r([Hm,  x^])  2  r([Ji#  x  ]),  and 
therefore,  r([Hm>  x^])  2  r([Hm>  x±]) . 

Lemma  5:  If  Hm  =  minfH^  ...,  H  }  ,  then  for  all  i,  Isis  (m-1), 
r(|Hm,  x„])  =  r([Jlf  *1+1]). 

Proof-  Let  i  be  any  integer  such  that  Is  i  s  (m-1). 

By  Lemma  4  r([Hm,  xj)  =  r([1lm>  x^]),  r([Hm>  x^])  =  r([Bm,  x^]), 

•••’  r<[Hm’  *i+2])  “  xi+l»'  Hen“-  r<"V  x1+1». 

We  have  H  ^  ^  J.  <  x ...  That  is  the  picture: 

mil  l+l  r 


Hence,  (Hm>  *1+1)  a  Ijj,  *1+11.  Hence  r(|Hn>  xj)  =  rUJj,  x.+1)).  ^ 

Completion  of  the  Proof  of  Theorem  1:  Without  loss  of  generality  we 

assume  H  =  min{H. . H  }.  By  Lemma  5, 

m - 1  nr  ’ 


r([H  ,  XJ)  2  U  r([J.,  X..J). 

m  m  i=^  i’  l+l 

By  part  2)  d  >  of  Theorem  1  we  have  for  some  i,  1  <:  i  £  n,  r([J  ,  x  ]  0 

m  m 

L.  =  0  and  r(x  )  €  U  .  By  part  2)  c)  of  Theorem  1,  r([H  ,  x  ])  = 

A  m  1  mm 

r([J  ,  x  ]).  Hence, 
mm 
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m-1 

U  rCtJj.  xi+1l)  n  L.  =  (J, 

and 

m-1 

u  r(iji.  xi+ii)nui  0. 

Therefore,  by  (IT)  (r  |  tt)  €  [H]. 

□ 

Section  3:  Remarks 

In  rs]  Rabin  uses  the  following  definition. 

Definition:  An  f ,a. t.  with  designated  subsets  is  a  system  Ql  - 

<  S,  E,  M,  Sq,  y  >,  where  S  is  a  finite  set  of  states .  E  is  a  finite 

set,  M:  S  X  E  -*  P(S  X  S) ,  and  5  £  P(S)  is  the  set  of  designated  subsets. 

An  Ol-run  on  t  =  (v,T)  is  as  defined  in  Section  2.  OX  accepts  t  if 

there  exists  an  r  €  Rn(#,t)  such  that  for  all  paths  tt  c  t,  In(r  |  tt)  €  ?. 

The  proof  of  Theorem  1  can  be  extended  to  show  that  r([H  ,  x  ])  = 

m  m 

m-1 

U  where  H  ,  x  ,  etc.  are  as  in  the  proof  of  Theorem  1. 

i=l  1 

Hence  for  0{=  <  S,  {a},  M,  sQ,  V  >,  where  c(S)  =  q,  we  have: 

T (01)  4  0  «  for  some  finite  tree  E  there  exists  an  r  such  that 

1)  r  €  Rn(0l,E), 

2)  there  exist  mappings  J:  Ft (E)  -»  E-Ft(E)  and  H:  Ft(E)  -»  E-Ft(E) 
such  that 

a)  H(x)  £  J(x)  <  x, 

b)  r(J (x) )  =  r(x) , 

c)  r([H(x),  J(x)])  =  r ( [J (x) ,  x]), 

d)  r([j(x),  x])  6  y. 

T 


1A 


The  appropriate  definition  of  a  good  string  with  respect  to  (71 

is  a  simple  modification  of  the  definition  of  good  stf'-.ig  used  in  the  proof 

of  Theorem  2.  For  either  definition  of  good  string  we  can  design  a  non- 

deterministic  finite  automaton  on  finite  strings,  !0!,  which  recognizes 

the  set  of  good  strings  and  which  has  at  most  2^(q+l)  states.  By  the 

subset  construction  we  can  design  a  deterministic  automaton  SDl'  equivalent 

to  Dll  such  that  33?'  has  at  most  Q  =  2^  states.  Using  Hit'  we  can 

easily  construct  a  finite  automaton  on  finite  trees,  (TV,  such  that  T(Ol') 

4  0  if  and  only  if  T(0|)  4  <t>  and  such  that  the  state  set  of  0\J  is  the 

cross  product  of  the  state  sets  of  01  and  JIM  .  Hence  011  has  at  most  qQ 

3 

.  states.  We  can  determine  whether  T(Ol')  4  0  in  (q  Q)  computational 
steps. 

Hence  given  a  finite  automaton  01  on  infinite  trees  which  has  q 

states  and  uses  either  notion  of  acceptance,  we  can  determine  whether  or 

3 

computational  steps. 


not  T(Ol)  4  0  in  q  22  ) 


Remark  2;  If  we  have  a  finite  E-tree  (v,E),  and  a  function  J:  Ft(E)  -» 
E-Ft(E)  such  that  for  all  x  €  Ft(E),  v(J(x))  =  v(x) ,  then  we  can 
generate  a  unique  D-tree  (v,T)  as  in  the  proof  of  Theorem  1.  Call  any 
2>tree  which  can  be  generated  in  this  way  a  finitely-generable  Z>tree. 
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Rabin  in  [4]  defines  a  E-tree,  (v,T),  to  be  regular  if  and  only 

N  -1  ^ 

if  for  each  c  €  S,  v  (a)  is  a  regular  subset  of  {0,1}  .  It  is  easily 

shown  that  a  E-tree  is  finitely-generable  if  and  only  if  it  is  regular. 

Remark  3:  From  Theorem  1  it  is  easily  shown  that  if  an  f.a.t.  accepts 
any  E-tree,  then  it  accepts  a  finitely-generable  E-tree.  Rabin  shows 
this  in  [4].  In  [21  Buchi  and  Landweber  prove  that  if  P(X,Y)  is  a 
finite-state  condition  and  X  has  a  winning  strategy,  then  X  has  a  winning 
finite-state  strategy.  Rabin  and  Rackoff  have  independently  observed 
that  the  set  of  winning  strategies  for  X  corresponds  in  a  natural  way 
to  a  set  of  {0,1} -trees  defined  by  a  (deterministic)  infinite  tree 
automaton.  Hence,  it  easily  follows  from  Rabin's  result  in  [4]  or  from 
the  results  in  this  paper  that  if  X  has  a  winning  strategy  then  X  has  a 
winning  finite-state  strategy. 

C.  Rackoff  has  observed  the  following.  If  X  does  not  have  a  winning 

strategy,  then  by  our  Theorem  1  we  see  that  X  does  not  have  a  "partial" 

strategy  of  a  particular  kind.  From  this  one  can  show  that  Y  has  a 

winning  strategy  for  P(X,Y),  thus  showing  that  P(X,Y)  is  determined. 

,  « 

This  is  another  result  of  [2]. 

We  thank  Albert  Meyer  for  his  assistance  in  writing  this  paper  and 
for  pointing  out  the  relevance  of  finite  tree  automata  to  our  work. 
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